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(54) Evaluation method for a hereditary algorithm 

(57) An evaluation method for a hereditary algo- classified, 
rithm is disclosed in which the evaluation conditions of 
individuals are subdivided and the data for evaluation is 
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Description 

[0001] This invention relates to a technical field of objectively evaluating individuals in a control method using hered- 
itary algorithm. 

s [0002] Conventionally, the characteristics of a product such as a vehicle, a household electric appliance, etc. as the 
subject to be controlled have been determined, in development and engineering stages, to adapt to as wide a range of 
users as possible by taking into consideration additional factors such as the users' preferences and the environment in 
which the product is used. However, since the users have widely varied respective personalities of their own, it is impos- 
sible to provide characteristics that satisfy all the users. To solve this problem, a control method has so far been tried in 

10 which neural networks are used to estimate the users' preferences and the environment for use. and hereditary algo- 
rithm has been used to find characteristics that can satisfy the users. 

[0003] In the hereditary algorithm constituted by simulating the process of natural evolution, a user generally subjec- 
tively evaluates individuals in the same generation, and hereditary manipulation is performed according to the evalu- 
ated values. However, in the case the hereditary algorithm is applied to the control of an engine for example in which 

is the control results in a plural number of operation statuses, since the output varies widely depending on the input con- 
ditions, it is difficult to objectively compare individuals by simply giving one evaluation value to one individual. As a 
measure for this problem, it is possible to classify data for evaluation into subdivided evaluation regions and evaluate 
them as a whole. However, this evaluation method has had so far a problem. That is, for any evaluation region that does 
not have data for all the individuals, it is necessary to wait until all the data come up, or to manipulate to exclude that 

20 region from the subject of evaluation. This is inefficient in the evaluation of individuals and also has a problem of diffi- 
culty in making appropriate evaluation. 

[0004] Therefore, it is an objective of the present invention to provide an evaluation method capable of solving the 
above-described problems encountered when evaluating individuals by applying the hereditary algorithm to the control 
which results in a plural number of operation statuses as with an engine, and making evaluation possible when data for 
25 all the individuals is not present in an evaluation region, and achieving efficient and objective evaluation with less 
number of evaluations. 

[0005] According to the invention, this objective is solved by an evaluation method for a hereditary algorithm, the eval- 
uation conditions of individuals are subdivided and that the data for evaluation is classified. 

[0006] According to an embodiment of the invention, the evaluation method of the hereditary algorithm of this inven- 
30 tion is characterized in that, when evaluating individuals in the hereditary algorithm in subjects to be controlled for which 
the control results turn up in a plural number of operation statuses, data for evaluation is classified into subdivided eval- 
uation regions and that evaluation values of the individuals are objectively calculated. 
[0007] Other preferred embodiments of the present invention are laid down in further dependent claims. 
[0008] In the following, the present invention is explained in greater detail with respect to several embodiments thereof 
35 in conjunction with the accompanying drawings, wherein: 

FIG. 1 shows the basic concept of the control method to which this invention is applied;. 
FIG. 2 is a chart for explaining the flow of process of the control method shown in FIG. 1 ; 

FIG. 3 is a simplified explanatory drawing of a control device for executing the control method shown in FIG. 1 asso- 
40 ciated with an engine; 

FIG. 4 shows the constitution of the control device shown in FIG. 3; 

FIG. 5 is for explaining the process of the evaluation system shown in FIG. 4; 

FIG. 6 is for explaining the process of the evaluation system shown in FIG. 4; 

FIG. 7 is for explaining the process of the evaluation system shown in FIG. 4; 
45 FIG. 8 is for explaining the process of the evaluation system shown in FIG. 4; 

FIG. 9 is for explaining the process of the evolution-adaptation system shown in FIG. 4; 

FIG. 10 is for explaining the process of the evolution-adaptation system shown in FIG. 4; 

FIG. 1 1 is a flow chart showing an evolution example of a module using hereditary algorithm out of processes of 
the evolution-adaptation system shown in FIG. 4; 
so FIG. 12 is for explaining the process shown in FIG. 11; 
FIG. 13 is for explaining the process shown in FIG. 11; 
FIG. 14 is for explaining the process shown in FIG. 11; 

FIG. 15 is a flow chart showing an embodiment of the evaluation method of hereditary algorithm of the invention; 
FIG. 16 is for explaining the process shown in FIG. 15; 
55 FIG. 17 is for explaining the process shown in FIG. 15; 
FIG. 18 is for explaining the process shown in FIG. 15; 
FIG. 19 is for explaining the process shown in FIG. 15; 

FIG. 20 is a flow chart showing an example of applying the evaluation method of the invention to an engine; and 
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FIG. 21 is for explaining the evaluation method shown in FIG. 20. 

[0009] Embodiments of the invention will be hereinafter described in reference to the appended drawings. FIG. 1 
shows the basic concept of the control method to which this invention is applied. According to the invention, the hered- 

5 itary algorithm is applied to subjects to be controlled for which the control results turn up in a plural number of operation 
statuses as with engines, electric motors, air-conditioners, refrigerators, and robots. This control method comprises 
three control layers; a reflection layer, a learning layer, and an evolution adaptive layer. Information on a subject to be 
controlled (such as information on operation status) to be controlled is inputted from outside. Based on the input infor- 
mation, a basic manipulation amount is determined in the refection layer. A correction amount is determined in the 

10 learning layer and the evolution adaptive layer. From these basic manipulation amount and the correction amount, a 
final control amount is determined and outputted. Functions of the reflection layer, the learning layer, and the evolution 
adaptive layer wilt be described below. 

[001 0] The reflection layer is the one provided in advance with an equation of relationship between information on the 
subject to be controlled (hereinafter referred to as external information) and the manipulation amount for the external. 
is information in a control system of a form such as a map, fuzzy rule, neural network, or subsumption architecture, and 
when the external information is inputted, determines and outputs a basic manipulation amount relative to the external 
information from the control system. The subsumption architecture is publicly known as active type artificial intelligence 
for carrying out parallel processing. 

[001 1 ] The evolution adaptive layer comprises two control systems; an evaluation system and an evolution-adaptation 

20 system. The evaluation system receives input of information on the external information and the user's characteristics 
(such as preference, skill, state in use) and information on characteristics of use situation (such as change in the envi- 
ronment of use) and estimates the characteristics of the user of the subject to be controlled and the use situation from 
the external information and at the same time, performs evaluation during the evolution process in the evolution-adap- 
tation system based on the characteristics of the user and the use situation. 

25 [001 2] The evolution-adaptation system is provided with a plural number of control modules for correcting the basic 
manipulation amount determined in the reflection layer to adapt to the characteristics of the user and the use situation. 
The system evolves the control module in a hereditary manner according to the determination with the evaluation sys- 
tem, and acquires at least one currently optimum control module. After acquiring the optimum control module, the evo- 
lution-adaptation system fixes the control module to the optimum one and outputs an evolution correction value for 

30 correcting the basic manipulation amount outputted from the reflection layer. 

[001 3] The learning layer is provided with two control systems interchangeable between learning and execution. While 
a control is being executed in the control system for execution, learning is carried out in the control system for learning 
for both of the input-output relation concerning the evolved optimum control module of the evolution adaptive layer and 
the input-output relation of the control system for execution of the learning layer. When the learning is over in the control 

35 system for learning, the control system which is executing the control and the post-learning control system replace each 
other, a control with the control module acquired from the learning result is started in the post-learning control system, 
and the control system which has been executing the control starts functioning for learning. 

[001 4] The evolution adaptive layer, after making the learning layer learn the information on the optimum control mod- 
ule, returns its output to zero, operates at constant time intervals, evaluates the user's preference and use environment, 
40 and evolve the control module. When the evaluation added with the output of the evolution adaptive layer becomes 
superior to the evaluation not added with the output of the evolution adaptive layer, again makes the learning layer learn 
the information on the optimum control module. 

[0015] Here, it is arranged that the information on the control module finished with learning in the learning layer is 
stored to be read in external memory means such as an IC card and floppy disk, a user can read as required the infor- 
ms mation on the optimum control module in the past from the external memory means, and a basic correction amount is 
outputted with the learning layer. 

[0016] With the functions of both of the layers described above, the control output with this control method changes 
momentarily so that the subject to be controlled to be controlled adapts to the characteristics of the user and the use 
environment. As a result, the action characteristics of the subject to be controlled momentarily change to adapt to the 
so characteristics of the user and the use situation. With this control method, the characteristics of the subject to be con- 
trolled keep on evolving to adapt to the characteristics of the user and the use situation. 

[0017] FIG. 2 is a chart for explaining the flow of process of the control method shown in FIG. 1. In the initial state, 
output from the learning layer is zero (step (a)). Therefore, immediately after the start of use of the subject to be con- 
trolled, the subject to be controlled is controlled only with the basic manipulation amount from the reflection layer. When 
55 the use of the subject to be controlled is started, the evolution adaptive layer evaluates the characteristics of the user 
and/or use situation and evolves the control module according to the evaluation values (step (b)). The evolution adap- 
tive layer acquires a currently most preferable control module by hereditarily evolving respective modules (step (c)). 
[0018] The evolution adaptive layer fixes (locks) its control module to the most preferable control module acquired in 
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the step (c), outputs an evolution system correction value based on the control module, and corrects the basic manip- 
ulation amount outputted from the reflection lay r. In the learning layer, the input-output relation of the evolution adap- 
tive layer at the time the evolution adaptive layer is fixed to the most preferable module and the input-output relation of 
the control system for execution of the learning layer are put together with the control system for learning, and learning 

5 is carried out. Incidentally, while the output of the control system for execution of the learning layer in the initial state is 
zero, after the learning, the basic manipulation amount from the reflection layer is corrected with the basic correction 
amount from the learning layer and with the evolution correction amount from the evolution adaptive layer (step (d)). 
[001 9] When the difference between the value of the basic manipulation amount from the reflection layer plus the out- 
put of the control system for learning in the learning layer and the actual control output (basic manipulation amount + 

10 basic correction amount + evolution correction amount) becomes smaller than a threshold value, the control system in 
the learning layer finishes the learning, the control system for learning and the control system for execution replace 
each other, the control system that has finished learning serves as one for execution, and the control system that has 
executed the control serves as one for learning (step (e)). In this way, control is performed with the reflection layer and 
the learning layer (step (f)). 

is [0020] The evolution adaptive layer, after making the learning layer learn the information on the optimum control mod- 
ule/works at constant time intervals to evaluate the time-wise displacement of the control rule of the learning layer (step 
(g)). In concrete terms, when no improvement is seen in the maximum adaptation degree in the initial generation when 
the control module of the evolution adaptive layer is made to evolve in hereditary manner, it is deemed that no displace- 
ment in the control rule of the control layer exists, the process goes to the step (f), control is continued with the reflection 

20 layer and the learning layer. When improvement is found in the maximum adaptation degree, the process moves on to 
the step (b) and a new optimum control module is acquired in the evolution adaptive layer. 

[0021] The above-described control method will be described more in detail for the case the subject to be controlled 
is an engine for vehicles as an example. FIG. 3 is a simplified explanatory drawing of a control device 10 for executing 
the control method shown in FIG. 1 associated with an engine 1 . The control device 10 receives input data of the engine 
25 revolution, intake air vacuum, throttle opening degree, rate of change in throttle opening degree, atmospheric pressure, 
intake air temperature, cooling water temperature, gear shift position (gear position), etc. Based on these pieces of 
information, control signals are issued to the fuel injection device, intake air control valve, intake valve, exhaust valve, 
and exhaust control valve to control the engine. 

[0022] FIG. 4 shows the constitution of the control device shown in FIG. 3. This control device 10 comprises the 
30 above-described three layers; the reflection layer, learning layer, and evolution adaptive layer. The reflection layer 
receives the signals of the engine revolution, intake air vacuum, throttle opening degree, rate of change in the throttle 
opening degree, atmospheric pressure, intake air temperature, and cooling water temperature. Based on these signals, 
a control manipulation amount of the fuel injection rate is determined from a predetermined fuel injection model, and 
outputted. 

35 [0023] The evolution adaptive layer comprises an evaluation system and an evolution-adaptation system. The evalu- 
ation system is provided with a neural network (See FIG. 7) which has learned the relation between the distribution pat- 
tern of maximum revolutions in respective gear positions within a certain period of time (See FIGs. 5 and 6) and the 
running state index P, receives input of a gear position signal and an engine revolution signal, determines a running 
state index P from the input information using the neural network. For example, a user who prefers sporty running tends 

40 to run the engine to a higher revolution in a lower gear position. Therefore, the revolution distribution patter becomes as 
shown in FIG. 5(a). A user who prefers a mild running tends to shift up the gear earlier in comparison with the sporty 
user. As a result, the revolution distribution pattern becomes as shown in FIG. 5(b). Therefore, when the neural network 
shown in FIG. 7 is made to learn in advance so that the running state index P takes a great value when the revolution 
distribution pattern is as shown in FIG. 5(a) and that the running state index P takes a small value when the revolution 

45 distribution pattern is as shown in FIG. 5(b), the running state index P obtained from the neural network becomes 
greater as the preference of the user for running is more sporty, and becomes smaller as the preference of the user for 
running is milder. In this way, the preference of the user is reflected on the running state index. 
[0024] Here, learning with the neural network may be set as follows: As shown in FIG. 6(a), when all the gears from 
the first to sixth speeds are used within a certain period of time, the value of the running state index P becomes great: 

so as shown in FIG. 6b), when lower gears only are used, the value of the running state index P becomes slightly great; 
and as shown in FIG. 6(c), when higher gears only are used, the value of the running state index P becomes small. With 
such a setting, the vehicle will use all the gears in a normal run, lower gear only in a jammed traffic, and higher gears 
only in a high speed run. Therefore, the following estimations based on the running state index P are possible: the case 
of FIG. 6(a) represents a normal run, FIG. 6(b) a run in a traffic jam, and FIG. 6(c) a run on a highway. 

55 [0025] The evaluation system estimates the current running state from the running state index P and also determines 
whether the user prefers to attach importance to fuel economy performance or to acceleration performance, and deter- 
mines an acceleration priority rate y. The acceleration priority rate y is set as shown in FIG. 8 approximately in propor- 
tion to the running state index P. When the time before reaching the maximum revolution is short, the acceleration 
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priority rate y is great and when the time befor reaching the maximum revolution is long, the acceleration priority rate 
y is small. 

[0026] The evolution-adaptation system is provided with an inferior module comprising a fuel economy module 
intended for acquiring a fuel injection control rule which brings about the best fuel economy and a power module 

5 intended for acquiring a fuel injection control rule which brings about the maximum output, and with a control module 
intended for acquiring output ratio of the fuel economy module versus the power module. Each of the above-described 
modules is constituted with hierarchy type neural network of two inputs and one output as shown in FIG. 9. The fuel 
economy module and the power module receive the input of normalized engine revolution and normalized throttle open- 
ing degree, and output a primary output value of the evolution correction amount. The control module receives the input 

10 of normalized throttle opening and normalized throttle opening change rate, and determines the final output value of the 
evolution correction amount by outputting the output ratio of the inferior modules (the fuel economy module and the 
power module). 

[0027] The fuel economy module and the power module respectively make the coupling factors of respective neural 
networks evolve autonomously in succession irrespective of operation state and user's preference as shown in FIG. 10 

75 using hereditary algorithm to acquire an air-fuel ratio correction amount so that an air-fuel ratio for the best fuel econ- 
omy and an air-fuel ratio for the maximum output are acquired. In contrast to this, the control module makes the cou- 
pling factor of its neural network evolve autonomously using the hereditary algorithm to acquire an output ratio of the 
fuel economy module and the power module that meets the user's preference between the best fuel economy air-fuel 
ratio and the maximum output air-fuel ratio. 

20 [0028] Next, the evolution of a module with the hereditary algorithm will be described. FIG. 11 is a flow chart for 
explaining an example of the evolution of the fuel economy module. FIG. 12 is for explaining the process shown in FIG. 
1 1 . First, coupling factors of neural networks constituting the fuel economy module are coded as genes to generate a 
first generation of a plural number (nine in this embodiment) of individuals a(j) (step 1). Here, it is possible to keep the 
versatility of the group of individuals in the process of evolution even if there is a limit in the number of individuals while 

25 maintaining the pre-evolution performance by including in the group of individuals one individual that can make the out- 
put of the evolution adaptive layer zero. 

[0029] Next, for one individual a(1) for example in one of the individuals a(j)„generated in the step 1 . a neural network 
output x corresponding to an actual input information (engine revolution and throttle opening) is determined using the 
neural network of the fuel economy module (step 2). The output is further converted linearly using the equation below 
30 to determine an output yf(1) of the fuel economy module for the individual a(1). 

yf (n) = 2 x Gx(n) — G 

where x(n) is the output of the neural network in the fuel economy module, G is the output gain of the evolution adaptive 
35 layer, and n is any individual. When the output x of the neural network is linearly converted and used in this way, the 
output yf(1) from the fuel economy module does not become an extremely great value, the evolution as a whole pro- 
ceeds little by little, and the behavior of the engine does not vary extremely due to evaluation and evolution. 
[0030] After the output yf(1) of the fuel economy module for the individual a(1) is determined, the output of the evolu- 
tion adaptive layer (correction value Ya(n) for evaluation) is determined with the equation shown below using the power 
40 module output ya and the control module output OR (step 4). 

Ya(n) =ORxya + (1 — OR)xyf 

[0031] Incidentally, the coupling factors of the power module and the control module are fixed during the evolution 
45 process of the fuel economy module. As shown in the equation above, the control module output OR is the ratio of the 
fuel economy module output yf to the power module output yf. Therefore, when the control module output OR is 1 , the 
output of the evolution adaptive layer becomes the power module output, and when the output OR is 0, the output of 
the evolution adaptive layer becomes the fuel economy module output. 

[0032] Next, the output Ya(1) of the evolution adaptive layer for the individual a(1 ) is actually issued from the evolution 
so adaptive layer. The correction value Ya(1) for evaluation and the basic correction value Yb from the learning layer are 
added to the basic manipulation amount from the reflection layer. The control output corrected with the correction value 
of Ya(1) + Yb is used to operate the engine (step 5): While actually performing the control using the individual a(1), infor- 
mation on the control result is fed back in the evaluation system of the evolution adaptive layer to determine the evalu- 
ation value (here, fuel consumption amount) for the individual a(1) is determined (step 6). 
55 [0033] When the above-descrtoed steps 1 through 6 is assumed to be one cycle of preliminary evaluation process 
including the calculation of evaluation values for all the nine individuals a(1) through a(9) generated in the step 1, the 
preliminary process is repeated for a predetermined number of cycles (step 7). After the evaluation values for all the 
individuals are calculated for the predetermined number of cycles, the process goes to the overall evaluation of each 
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individual (step 8). In the overall evaluation, an overall evaluation value is calculated from the total travel distance during 
the evaluation value calculation cycles divided by the total of all the evaluation values (here, total fuel consumption 
amount). Based oh the overall evaluation value, adaptation degree of each individual is evaluated. 
[0034] As shown in FIG. 13, it is possible to evaluate respective individual fairly under the almost uniform conditions 
even under momentarily changing running conditions by operating respective individuals in a quasi parallel manner by 
time division and by performing the control using the individuals for a specified number of times by turns, and to perform 
an on-line control, namely to evaluate the vehicle while it is running. 

[0035] After the overall evaluation process is over, it is determined if the generation to which the individuals belong is 
the final (step 9). If not, parent incfividuals are selected (step 10). This selection uses a roulette type of method to select 
a certain number of parent individuals with probabilities in proportion to the adaptation degrees of respective individu- 
als. Here, since an individual of a high evaluation might be destroyed if change of generation is applied too strictly, a 
preservation strategy is also used to leave a best individual (individual of the highest evaluation) unconditionally for the 
next generation. 

[0036] When the selection of the parent individuals is over, the selected individuals as parents are crossed to gener- 
ate a second generation comprising nine child individuals (step 11). For the crossing between individuals, known meth- 
ods such as one point crossing, two point crossing, and normal distribution crossing are used. Values (coupling 
degrees) of genes are randomly changed with a certain probability to cause mutation of genes for the nine individuals 
generated. Here, it is arranged that one individual that is capable of making the output of the evaluation-adaptation layer 
zero is included as one of the nine child individuals. 

[0037] After the second generation is generated with the above-described process, the preliminary evaluation process 
from the step 2 is repeated. The process is repeated until the generated generation becomes a predetermined final 
generation. As a result/the child individuals constituting each generation evolve according to the evaluation with the 
evaluation system, namely in the case of the fuel economy module to acquire the fuel injection rule for the best fuel 
economy. In the case it is determined in the step 9 that the final generation is reached, an individual of a highest degree 
of adaptation (most suitable individual) is selected from the nine child individuals in the generation (step 12). The cou- 
pling factor of the neural network of the fuel economy module is fixed with the gene constituting the most suitable indi- 
vidual_(step. 13). The process.then goes.to.the.learning.for the learning control-module of-the-learning-layer. 
[0038] In the evolution process of the power module and the control module too, an evolution process similar to that 
of the fuel economy module described above is performed. However, the overall evaluation value for each individual in 
the power module is calculated as the average engine revolution during the evaluation value calculation cycle divided 
by the average throttle opening degree. As a result, the child individuals constituting respective generations in the proc- 
ess of evolution of the power module evolve along the evaluation of the evaluation system, namely so as to acquire a 
fuel injection control rule that provides a best output. The overall evaluation value CNT for each individual in the control 
module is expressed with the equation below, assuming the fuel economy evaluation value during the evaluation value 
calculation cycle to be FC, the response evaluation value to be RP, the acceleration priority rate to be y, the reference 
fuel economy evaluation value to be FCbase, and the reference response evaluation value to be RPbase. 

CNT = (1 — y) x Scale x (FC — Fcbase)/Fcbase + y x (RP — RPbase)/RPbase 

where Scale is a factor for keeping balance between the fuel economy evaluation value and the response evaluation 
value. The fuel economy evaluation value FC is calculated similarly to the overall evaluation value in the fuel economy 
module. Concerning the response evaluation value RP, if change in the throttle opening degree greater than a threshold 
value continues for a predetermined period of time, it is deemed to be an acceleration operation. The change in the 
speed at that time is divided by the rate of change in the throttle opening degree. The result is made the average value 
calculated for each acceleration within the period of time of the specified evaluation value calculation cycle. 
[0039] As described above, as the fuel economy evaluation value and the response evaluation value are evaluated in 
accordance with the acceleration priority rate y determined on the basis of the user's preference, the control module 
evolves to acquire an output ratio of the fuel economy module and the power module commensurate with the operation 
state in accordance with the user* s preference. 

[0040] Next, the learning layer will be explained. The learning layer as shown in FIG. 4 is provided with control module 
groups corresponding in types to the control modules of the evolution adaptive layer. Each control module group com- 
prises a neural network for learning and a neural network for execution. The control module in the learning layer learns 
the input-output relation of the evolution adaptive layer with its neural network for learning every time the corresponding 
control module of the evolution adaptive layer evolves by a specified number of generations together with the input-out- 
put relation of the neural network functioning as one for execution of the learning layer. 

[0041] The above-described learning is finished when the difference between the output of the learning neural net- 
work in the process of learning and the control output becomes smaller than a threshold value. After that, the neural 
network for learning becomes the one for execution and the neural network originally for the control becomes the one 
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for learning. This learning is performed as described above every lime the evolution process for the control module in 
the a/olution adaptive layer is performed for a specified number of generations. Therefore, learning is performed every 
time the evolution process is performed for a specified number of generations during the period from the start of an evo- 
lution process for one control module to the converge nc of the evolution. In this way, by repeating evolution and I earn - 
5 ing by turns for each control module, as shown in FIG. 14, it is possible to make the evolution proceed faster as the 
evaluation values are improved faster than the case in which evolution is made with the evolution process only without 
causing the learning to occur. 

[0042] Next, the on-line evaluation method of the hereditary algorithm of the invention will be explained. FIG. 15 is a 
flow chart showing a basic concept as an embodiment FIG. 16 is for explaining the evaluation region. 
70 [0043] First, data for evaluating the individuals (j) are acquired, the acquired evaluation data are classified into subdi- 
vided evaluation regions (i) (FIG. 16) (step 1). The k-th data in the region (i) is assumed to be f(i, j, k). Incidentally, while 
m this example the evaluation regions for classifying the evaluation data are represented in a two-dimensional table, the 
evaluation data may also be subdivided using evaluation conditions (parameters) into regions in two-dimensional or 
three-dimensional regions. 

is [0044] Next, m the step 2, a reference value of the model is calculated for each evaluation region, and the reference 
value * the average value of the data included in the evaluation region. Here, to improve the accuracy of the average 
value without increasing the number of individuals used for calculating the average value, the average value of the eval- 
uation data contained in an area including the outskirts of an evaluation region is used as the reference value for the 
evaluation repon (■) That is to say, the average value for the hatched region i ( (set U(i)) including the outskirts of the 

20 region (■) m FIG 16 e used as the average value for the region (i), which is expressed with the equation below. 
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where f(r. j ^represents data in the region i' (i* <= U(i)), individual j, and observation k. N(i') is the total number of data 
in the set U(i) ' 

[0045] Next tn the step 3, to equalize the rate of contribution to the evaluation value of evaluation regions, the evalu- 
30 ation data are converted so that the average value and the variance become equal from one evaluation region to 
another Tnts process is applied as shown in FIGs. 17 and 18; when the average value and the variance in one evalu- 
ation region are different from those in another, they are normalized so that the contribution rates of the evaluation val- 
ues (estimated by the least squares method to be described later) of the respective evaluation regions become equal 
to each other 

35 [0046] fust, to normalize the average value, using the equation (1), data are converted to f(i, j, k) according to the 
equation (2) (See FIG. 17). 

f 0. j- k ) =f "^y^ [Equation 2] 



40 



[0047] Then, the variance is normalized. Data conversion without changing the average value is expressed with the 
equation 3 using (b) as the conversion factor. 

f"('. J. k)=f (i, j, k)+{f'(i. j, k)-f (i)}b «r(i. j, k)+{f (i, j, k)-1)b [Equation 3] 



where f(i) is an average value in the region i after the data conversion for normalizing the average value and expressed 
with the equation 4 with the number of data in the region i as N(i). 

so 

f'(i)=E £f(i. j. k)/N(i) %1 [Equation 4] 

j k 

55 

[0048] The variance c" after the data conversion is expressed with the equation 5. 
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S E{nU.k)-f"(i)} 2 £ £< f "(i j.k)-1} 1 



J l<_ 



(f'(i)=f(i)=1) [Equation 5] 



N(i) N(i) 

5 

where f'(i) is an average value in the region i after the data conversion for normalizing the variance and is expressed 
with the equation 6, and is expressed with the equation 7 assuming that the variance to be normalized is 1 . 

w f(i)=£ £f"(i ,j,k)/N(i) [Equation 6] 

j k 

=f'(i) 



1 k N(j) =1 [Equation 7] 

20 

£ £[f(«j.k)+{r(i.j.k)-1}b-1] 2 

-I— S =1 

N(i) 

25 

[0049] The equation 7. when the variance before the data conversion c' is used, is expressed with the equation 8. 
where b is a conversion factor. 

30 , c'(1+b) 2 =1 [Equation 8] 



35 



Z Z{f(".i.k)-1} 2 

b =i" 1 ^ J - JL im — > 



[0050] When the equation 3 is written in another form based on the above description, the evaluation data is finally 
converted into the equation 9 (See FIG. 18). 

40 1 

f , (ij.k)=f(i.j.k)+{f(ij,k)-1}(-l=.1) [Equation 9] 



[0051] Next in the step 4, evaluation values are determined from the factors relative to the reference value of the eval- 
45 uation data. In order that, the evaluation data in the respective evaluation regions of the individuals are made into mod- 
els by multiplying the reference value V by the factors a (i) as shown in the equation (10). 

f"(i.D=a(i)nO+K(ij.k) [Equation 10] 

50 

where e (i, j, k) is the remainder. 

[0052] Next, factors a Q) are estimated from the data f (i» j) for the individuals (j) using the least squares method so 
that the sum of the squares of the remainders shown in the equation 1 1 is minimized (See FIG. 19). 



55 
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[Equation 11] 



m 



70 

[0053] However, when the evaluation value FQ) of the individual (j) is given by the weighted sum of the evaluation data 
a (j)f(i) in each region, the evaluation value F(j) is expressed with the equation 12: 

is FO)=^;N(i)aa)r(i)=aO)S N (') [Equation 12] 

it 

[0054] As is clear from the equation 12, since the comparison of F(j) is simply the same as the comparison of a (j), 
20 the a G) may be used as the evaluation value. It is determined that the greater the a Q), the higher the evaluation. 

[0055] Incidentally, while the evaluation data are converted in the above-described embodiment so that both of the 
average value and the variance are equal from one evaluation region to another, the data may also be converted so that 
either the average value or the variance is equal. 

[0056] While the average value in the above embodiment is calculated using also the data for evaluation contained in 
25 the outskirts of the region in question, conversion of data for evaluation that will result in that the average value and/or 
variance is the same from one evaluation region to another may be made using the data contained in the outskirts of 
the region. This willbe explained below. 

[0057] The average value for the hatched region i' including the outskirts of the region (i) is assumed to be the average 
value for the region (i) which is expressed with the equation 13. 

30 

f(0s r g.i ( k)li^u ( i)}i ~ r€U " ko tEquation 131 

where f(i\ j, k) represents data in the region i* (i* <= U(i)), individual j, and observation k. N(i') is the total number of data 
in the set U(i). 

[0058] First to normalize the average value, respective data are converted to f(i\ j, k) using the equation 13 and 
according to the equation 14. 



35 



40 



fXi ^ ik)= !M [Equation 14] 

45 [0059] When the region (i) is noted, data contained in the region V are converted with the equation 2. 

[0060] Furthermore, the variance is normalized. The data conversion without changing the average value is 
expressed with the equation 15 with the conversion factor of (b). 

*"(i , .j.k)=f(i , J,k)+{fXi\j,k)-f(i)}b [Equation 15] 

so =f(i , j.k)+{f(i , j.k)-1}b 

where f(i) is the average value in the region i' after the data conversion for normalizing the average value, and is 
expressed with the equation 16. 

55 
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E ZZTO £ EEW> 

f(i)= r6U 0) i — !< = ''^U(i) i k TEauation 1 61 

|{f(r,j,k)|i*<=U(i)}| N(i7 Ltquauonibj 



=1 



io [0061] The variance c" after the data conversion is expressed with the equation 1 7. 



EE™.k)-f"(i)} 2 

' K m — " [Equation 1 7] 

E E{ni , .i.k)-i} 2 



N(0 

20 



(f(i)=f(i)=1) 



where f(i) * the average value in the region i' after the data conversion for normalizing the variance, is expressed with 
the equation 18 and expressed with the equation 1 9 assuming that the variance to be normalized is 1 . 

* E EZ r (i'j.k) E EE f, ^ k ) 

() " l{f(N.k)|i^U(i)}| - N(i') [Equation 18] 



30 



= 1 



EE{ f "(W1} 2 

35 J — !L -jyjjy) =*» [Equation 19] 

EEl^'iW^i^)- 1 } 5 - 1 ] 2 



=1 



40 N(r) 

[0062] The equation 19. if the variance c* before the data conversion is used, is expressed with the equation 20. 
45 c'(1+b) 2 =1 [Equation 20] 

E EflWM) 2 

b=JL-1 (where c'=-^L_ ) 

[0063] When the equation 1 5 is rewritten from the above, the evaluation data is finally converted with the equation 21 . 
55 t"0 , j.k)=r(i , j ( k)+{f(i',j,k)-1}(^ = -1) [Equation 21] 
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[0064] Next, the evaluation data in the respective evaluation regions for each individual are made into models as the 
factor multiple of the reference value like the equation 22 using the factor a G) and the reference value f"(i). 

n'J>aG)f"(i)+£(U.k) [Equation 22] 

5 ' 

where c (i, j, k) is the remainder. 

[0065] Next, a 0) are estimated from the data f"(i. j) for the individuals 0) using the least squares method so that the 
sum of the squares of the remainders shown in the equation 23 is minimized. 

10 

[Equation 23] 



1* min££e(i. j.k) : 



20 [0066] However, when the evaluation values F(j) of the individuals are given by the weighted sum of N(j) of the eval- 
uation data a 0)f"("). the evaluation values F(j) are given with the equation 24. 



F(j)=E N W«(i)*"(')=aG)S N ( i ) N ( i ) [Equation 24] 

25 j t 



[0067] As is clear from the equation 24, since the comparison of FQ) is simply the same as the comparison of a (j). 
the a G) may be used as the evaluation value. It is determined that the greater the a (j), the higher the evaluation. 

30 [0068] Next, an example of applying the evaluation method of this invention to an engine will be described. When the 
engine characteristics are evaluated on-line, individuals for response performance, fuel economy performance, and 
output are respectively independent different modules which cannot be compared with each other. Namely, as shown 
in FIG. 20, evaluation is made for each module: After determining the running state, each module is evaluated for the 
response performance if the running state is transient or for the fuel economy performance and the output if the running 

35 stat is stationary. 

[0069] FIG. 21(A) is for use in evaluating the response performance, with the evaluation region consisting of acceler- 
ation start engine revolution and average throttle opening, and with the response degree being used as the evaluation 
value. A local response degree is a value of an engine revolution changing rate during a period in which the throttle 
opening changing rate is a positive value divided by an average throttle opening changing rate. The greater the amount 

40 of change in the engine revolution relative to the amount of change in the throttle opening per unit time, the greater the 
value of the response degree. The characteristic of the engine revolution catching up the throttle opening; or the 
response performance is greatly affected with the air-fuel ratio during acceleration. The air-fuel ratio during acceleration 
is determined by the manner of operating the throttle under the same condition of the acceleration start engine revolu- 
tion. Therefore, the evaluation region is subdivided by the throttle opening changing rate which depends on the manner 

45 of throttle operation and by the acceleration start engine revolution, namely the running pattern which depends on the 
manner of throttle operation. 

[0070] FIG. 21 (B) is for use in evaluating the fuel economy performance and the output. The evaluation region con- 
sists of engine torque and revolution for both of the evaluations. The local evaluation values are respectively the fuel 
consumption amount and the throttle opening degree. The less the fuel consumption amount per unit time, the better 
so the fuel economy performance under the same conditions of the engine torque and engine revolution. Similarly, the 
smaller the throttle opening, the better the output. 

[0071 ] In the above-described embodiment, if the operation state is transient, the response performance is evaluated. 
If the operation state is stationary, the fuel economy performance and the output are evaluated. However, any other per- 
formances may be evaluated as long as is it possible to evaluate the dynamic characteristic in the transient state and 
55 the static characteristic in the stationary state. 

[0072] As is clear from the above description, with the invention of claim 1, subdividing the evaluation conditions of 
individuals and classifying the data for evaluation make it possible to compare the evaluation data of similar acquisition 
conditions under the same conditions, and to improve evaluation accuracy of individuals having characteristics with 
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their control results appearing in different operation regions. 

[0073] With the invention of claims 2 and 5, calculating the evaluation values using models makes it possible to eval- 
uate data contained in an evaluation region that does not have all the data for individuals, and to evolve with a small 
number of data. 

5 [0074] With the invention of claims 3 and 4, determining the average value and variance for the area including the 
outskirts when calculating the reference value of the model makes it possible to increase the number of individuals 
related to the calculation of reference value, and to improve the accuracy of the reference value. 
[0075] With the invention of claims 6 and 7. making uniform the degrees of contribution to the evaluation regions 
makes it possible to weight the evaluation region according to the user's characteristic, and to evolve the region emphat- 

w ically. 

[0076] With invention of claims 8 through 16, applying the evaluation method to engines or the like makes it possible 
to realize highly accurate, objective evaluation according to the preference, skill and condition of the user; use environ- 
ment, operation state, etc. 

75 Claims 

I . An evaluation method for a hereditary algorithm, characterized in that the evaluation conditions of individuals are 
subdivided and that the data for evaluation is classified. 

20 2. Evaluation method according to claim 1 , characterized in that data for evaluation is classified into subdivided eval- 
uation regions and evaluation values are objectively calculated when individuals in a hereditary algorithm are eval- 
uated in subjects to be controlled in which control results turn up in a plural number of operation statuses. 

3. Evaluation method according to claim t or 2, characterized in that an evaluation value of an individual is replaced 
25 with a model of a factor relative to a reference value by the use of the data for evaluation classified into the evalu- 
ation regions. 

4. Evaluation method according to claim 3. characterized in that the average of data contained in an area including 
the outskirts of the region to which the data for evaluation belong is used as the reference value for calculating the 

30 evaluation value model-wise. 

5. Evaluation method according to claim 3, characterized in that the average value and variance of data contained 
in an area including the outskirts of a region to which the data for evaluation belong are used as the reference val- 
ues for calculating the evaluation value model -wise. 

35 

6. Evaluation method according to at least one of the preceding claims 3 to 5. characterized in that when the evalu- 
ation value is calculated model-wise, a value determined by the least squares method from the factor, relative to 
the reference value, of each data for evaluation is made the evaluation value for the individual. 

40 7. Evaluation method according to at least one of the preceding claims 3 to 6, characterized in that concerning the 
data for evaluation classified into the evaluation regions, the data for evaluation are converted so that each evalu- 
ation region has the same degree of contribution to the evaluation value. 

8. Evaluation method according to claim 7. characterized in that concerning the data for evaluation classified into 
45 the evaluation regions, the data for evaluation are converted so that each evaluation region has the same average 

value and/or variance value. 

9. Evaluation method according to at least one of the preceding claims 1 to 8, characterized in that the subject to be 
controlled is an engine, an electric motor, an air-conditioner f a refrigerator, or a robot. 

50 

10. Evaluation method according to claim 9. characterized in that at least one of user's preference, user's skill and 
condition, environment for use. and operating condition is used as parameters for subdividing the evaluation region. 

I I . Evaluation method according to claim 9 or 1 0. characterized in that different evaluation methods for the subjects 
55 to be controlled are used for dynamic characteristics in a transient period and for static characteristics in a station- 
ary period. 

12. Evaluation method according to claim 11, characterized in that the dynamic characteristic is evaluated with 
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response performance. 

13. Evaluation method according to claim 12, characterized in that the subject to be controlled is an engine and that 
when individuals for the response characteristic are evaluated the evaluation region is subdivided with a running 

s pattern dependent on the manner of operating the throttle. 

14. Evaluation method according to claim 13, characterized in that a local evaluation value for the response perform- 
ance is obtained by dividing the change rate in engine revolution by the change rate in average throttle opening 
degree. 

10 

1 5. Evaluation method according to claim 1 1 , characterized in that the subject to be controlled is an engine and that 
the static characteristic is evaluated with at least one of fuel economy performance and output power. 

1 6. Evaluation method according to claim 15, characterized in that fuel injection amount per unit time in the evaluation 
75 region is used as the local evaluation value for the fuel economy performance. 

17. Evaluation method according to claim 15, characterized in that throttle opening in the evaluation region is used 
as the local evaluation value for the output power. 

20 
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[FIG. 2] 
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[FIG. 3J 
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(FIG. 5] 
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[FIG. 7] 
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[FIG. 10] 
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(FIG. 11] 
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[FIG. 13] 
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[FIG. 15] 
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[FIG. 17] 
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(FIG. 20] 
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